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(57) Abstract: In a near-instantaneously adaptive joint-detecuon CDMA-based transceiver used for wireless video telephony a 
method for transmission of a multimedia signal is described, the method comprising: providing a transmitter operable to transmit 
in a plurality of modulation modes varying in bit rate and error resilience between a highest bit rate, lowest error resilience mode 
and a lowest bit rate, highest error resilience mode; obtaining a channel quality measure for current transmission; and switching to a 
more or less error resilient modulation mode each time the channel quality measure respectively degrades or improves by a defined 
amount, whereby multimedia signal quality varies smoothly with varying channel quality of the transmission medium. 
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ADAPTIVE JOINT-DETECTION COMA VIDEO TRANSCEIVER 



« 1 Background of the Invention 

s The invention relates to burst-by- burst adaptive joint-detection Code Division Multiple Access (CDMA) 

6 based transmission of multimedia signals, such as interactive video or audio, speech etc. 

7 In contrast to the burst-by-burst reconfigurable CDMA multimedia transceivers described in this doc- 
s ument, the term statically reconfigurable found in this context in the literature refers to multimedia 
9 transceivers that cannot be near-instantaneously reconfigured. More explicitly, the previously proposed 
to statically reconfigurable video transceivers were reconfigured on a long-term basis under the base sta- 
ll tion's control, invoking for example in the central cell region - where benign channel conditions prevail 

12 - a less robust, but high-throughput modulation mode, such as 4 bit/symbol Quadrature Amplitude Mod- 

13 ulation (16QAM), which was capable of transmitting a quadruple number of bits and hence ensured a 

14 better video quality. By contrast, a robust, but low-throughput modulation mode, such as 1 bit/symbol 
is Binary Phase Shift Keying (BPSK) can be employed near the edge of the propagation cell, where hostile 
is propagation conditions prevail. This prevented a premature hand-over at the cost of a reduced video 
I? quality. 

ta The philosophy of the fixed, but program able-rate proprietary video codecs and statically reconfigurable 

19 multi-mode video transceivers presented by Streit et ai for example in References [1] was that irrespec- 

*> tive of the video motion activity experienced, the specially designed video codecs generated a constant 

zi number of bits per video frame. For example, for videophony over the second-generation Global System 

22 of Mobile Communications known as the GSM system at 13 kbps and assuming a video scanning rate of 

23 10 frames/s, 1300 bits per video frame have to be generated. Specifically, two families of video codecs 

24 were designed, one refraining from using error-sensitive run-length coding techniques and exhibiting the 

25 highest possible error resilience and another, aiming for the highest possible compression ratio. This 

26 fixed-rate approach had the advantage of requiring no adaptive feedback controlled bitrate fluctuation 

27 smoothing buffering and hence exhibited no objectionable video latency or delay. Furthermore, these 
2e video codecs were amenable to video telephony over fixed-rate second-generation mobile radio systems, 

29 such as the GSM. 

30 The fixed bitrate of the above proprietary video codecs is in contrast to existing standard video codecs, 

1 
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31 such as the Motion Pictures Expert Croup codecs known as MPEG I and MPEG2 or the ITU's H.263 

M codec, where the time-variant video motion activity and the variable- length coding techniques employed 

33 result in a time-variant bitrate fluctuation and a near-constant perceptual video quality. This time-variant 

34 bitrate fluctuation can be mitigated by employing adaptive feed-back controlled buffering, which po- 

35 tentially increases the latency or delay of the codec and hence it is often objectionable for example in 

36 interactive videophony. The schemes presented by Streit et al in References [1 ]„result in slightly variable 
3r video quality at a constant bitrate, while refraining from employing buffering, which again, would result 

38 in latency in interactive videophony. A range of techniques, which can be invoked, in order to render the 

39 family of variable- length coded, highly bandwidth-efficient, but potentially error-sensitive class of stan- 

40 dard video codecs, such as the H.263 arrangement, amenable to error-resilient, low-latency interactive 
*i wireless multimode videophony was summarised in (2]. The adaptive video rate control and packetisa- 
42 tion algorithm of [2] generates the required number of bits for the burst-by -burst adaptive transceiver, 
« depending the on the capacity of the current packet, as determined by the current modem mode. Fur- 

44 ther error-resilient H.263-based schemes were contrived for example by Farber, Steinbach and Girod 

45 at Erlangen University [3], while Sadka, Eryurtlu and Kondoz [4] from Surrey University proposed a 

46 range of improvements to the H.263 scheme. Following the above portrayal of the prior art in both video 

47 compression and statically reconfigurable narroband modulation, let us now consider the philosophy of 
4a wideband burst-by-burst adaptive quadrature amplitude modulation (AQAM) in more depth. 

49 In burst-by-burst adaptive modulation a higher-order modulation scheme is invoked, when the channel 

so is favourable, in order to increase the system's bits per symbol capacity and conversely, a more robust 

si lower order modulation scheme is employed, when the channel exhibits inferior channel quality, in order 

52 to improve the mean Bit Error Ratio (BER) performance. A practical scenario, where adaptive modular 

>a tion can be applied is, when a reliable, low-delay feedback path is created between the transmitter and 

54 receiver, for example by superimposing the estimated channel quality perceived by the receiver on the 

55 reverse-direction messages of a duplex interactive channel. The transmitter then adjusts its modem mode 

56 according to this perceived channel quality. 

57 Recent developments in adaptive modulation over a narrow-band channel environment have been pi- 
sa oneered by Webb and Steele [5], where the modulation adaptation was utilized in a Digital European 
59 Cordless Telephone - like (DECT) system. The concept of variable rate adaptive modulation was also 
so advanced by Sampei et al [6], showing promising advantages, when compared to fixed modulation in 
et terms of spectral efficiency, BER performance and robustness against channel delay spread. In another 

62 paper, the numerical upper bound performance of adaptive modulation in a slow Rayleigh flat-fading 

63 channel was evaluated by Torrance et al[l] and subsequently, the optimization of the switching threshold 
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* levels using Powell minimization was used in order to achieve a targeted performance [8. 9J. In addition 

« adaptive modulation was also studied in conjunction with channel coding and power control techniques 

« by Matsuoka etal [6] as well as Goldsmith «a/.[10]. 

" 10 thC narrow -b a "d channel environment, the quality of the channel was determined by the short term 

« Signal to Noise Ratio (SNR) of the received burst, which was then used as a criterion in order to choose 

. the appropriate modulation mode for the transmitter, based on a list of switching threshold levels. /„ [5 9] 

» However, in a wideband environment, this criterion is not an accurate measure forjudging the quality of 

n the channel, where the existence of multi-path components produces not only power attenuation of the 

. transmission burst, but also intersymbol interference. Subsequently, a new criterion has to be denned to 

» estimate the wideband channel quality in order to choose the appropriate modulation scheme. 

» 2 Summary of the Invention 

- Particular and preferred aspects of the invention are set out in the accompanying independent and depen- 
" dCnt C,aimS - Features of * e pendent claims may be combined with those of the independent claims as 
» appropriate and used in combinations other than those explicitly set out in the claims. 
78 The P crforma n« benefits of burst-by-burst adaptive modulation assisted CDMA are described, employ- 
n ing a higher-order modulation mode in transmission bursts, when the instantaneous channel quality is 
» favourable, ie when the received signal is unimpaired by co-channel interferes This procedure is em- 
ployed, in order to increase the system's bits per symbol (BPS) capacity and conversely, invoking a more 
« robust, lower order modulation mode, when the channel exhibits inferior channel quality. Therefore the 
" associated bit rate will be time-variant. 

. It is shown that due to the described adaptive modem mode switching regime a seamless multimedia 
« source-signal representation quality - such as video or audio quality - versus channel quality relation- 

- ship can be established, resulting in a near-unimpaired multimedia source-signal quality right across 
« the operating channel Signal-to-Noise Ratio (SNR) range. The main advantage of the described tech- 
» nique is that irrespective of the prevailing channel conditions, the transceiver achieves always the best 
~ possible source-signal representation quality - such as video or audio quality - by automatically adjust- 

- ing the achievable bitrate and the associated multimedia source-signal representation quality in order to 
.. match the channel quality experienced. This can achieved on a near-instantaneous basis under given 
« propagation conditions in order to cater for the effects of path-loss, fast-fading, slow-fading, dispersion. 
n co-channel interference, etc. Furthermore, when a mobile is roaming in a hostile out-doors - or even 
" hilly terrain - propagation environment, typically low-order, low-rate modem modes are invoked, while 
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95 in benign indoor environments predominantly the high-rate, high source-signal representation quality 

96 mocies are employed. 

97 3 Brief Description of the Drawings 

95 For a better understanding of the invention and to show how the same may be carried into effect reference 

99 is now made by way of example to the accompanying drawings, in which: 

100 List of Figures 

iot 1 Signalling scenarios in adaptive modems 19 

* y 2 Reconfigurable transceiver schematic 20 

.03 3 Transmission burst structure of the FMA1 spread speech/data mode 2 of the FRAMES 

io4 proposalfll] 20 

los 4 Normalized channel impulse response for the COST 207 seven-path Bad Urban channel. 21 

106 5 BER versus channel SNR 4QAM performance using BCH coded 13.7Kbps video, com- 

107 paring the performance of matched filtering and joint detection for 2-8 users 21 

los 6 BER versus channel SNR 4QAM performance using turbo-coded 1 1.1Kbps video, com- 

109 paring the performance of matched filtering and joint detection for 2-8 users 22 

7 Video packet loss ratio versus channel SNR for the turbo-coded 11.1 Kbps video stream, 
comparing the performance of matched filtering and joint detection for 2-8 users 22 

8 Video packet loss ratio (PLR) and feedback error ratio (FBER) versus channel SNR for 
the three modulation schemes of the 2-user multi-mode system using joint detection. . . 23 

9 Decoded video quality (PSNR) versus channel SNR for the modulation modes of BPSK, 
4QAM and 1 6QAM supporting 2-users with the aid of joint detection. These results 
were recorded for the Miss-America video sequence at SQCIF resolution (128x96 pels). 23 

10 Decoded video quality (PSNR) versus video packet loss ratio for the modulation modes 
of BPSK, 4QAM and 16QAM, supporting 2-users with the aid of joint detection. The 
results were recorded for the Miss- America video sequence at SQCIF resolution (128x96 

no pels) 24 

121 1 1 Example of modem mode switching in a dynamically reconfigured burst-by-burst mo- 

122 dem in operation, where the modulation mode switching is based upon the SINR estimate 

123 at the output of the joint-detector. 24 
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•24 12 PDF of the various adaptive modem modes versus channel SNR. 25 

125 1 3 Throughput bitrate versus channel SNR comparision of the three fixed modulation modes 

«2s (BPSK, 4QAM, 16QAM) and the adaptive burst-by-burst modem (AQAM), both sup- 

t27 porting 2 users with the aid of joint detection 25 

128 14 Average decoded video quality (PSNR) versus channel SNR comparision of the fixed 

»29 modulation modes of BPSK, 4QAM and 16QAM, and the burst-by-burst adaptive mo- 

iM dem. Both supporting 2-users with the aid of joint detection. These results were recorded 

Hi for the Miss-America video sequence at SQCEF resolution (128x96 pels) 26 

132 15 Video packet loss ratio (PLR) versus channel SNR for the three modulation schemes of 

133 the multi-mode system, compared to the burst- by -burst adaptive modem. Both systems 

134 substain 2-users using joint detection 26 

.as 16 Decoded video quality (PSNR) versus video packet loss ratio comparision of the fixed 

138 modulation modes of BPSK, 4QAM and 16QAM, and the burst-by-burst adaptive mo- 

137 dem. Both supporting 2-users with the aid of joint detection. These results were recorded 

138 for the Miss-America video sequence at SQCEF resolution (128x96 pels) 27 
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139 3.1 State-of-the-art 

>*o Burst-by-burst adaptive quadrature amplitude modulation (AQAM) was contrived by Steele and Webb [5], 

i4i in order for the transceiver to cope with the time-variant channel quality of narrowband fading channels. 

««z Further related research was conducted at the University of Osaka by Sampei and his colleagues, investi- 

i«3 gating variable coding rate concatenated coded schemes [6], at the University of Stanford by Goldsmith 

144 and her team, studying the effects of variable- rate, variable-power arrangements [10] and at Southamp- 

u5 ton University in the UK, investigating a variety of practical aspects of AQAM [12, 13]. The channel's 

i4« quality is estimated on a burst-by-burst basis and the most appropriate modulation mode is selected in or- 

i47 der to maintain the required target bit error rate (BER) performance, whilst maximizing the system's Bit 

1*8 Per Symbol (BPS) throughput. Using this reconfiguration regime the distribution of channel errors be- 

«9 comes typically less bursty, than in conjunction with non-adaptive modems, which potentially increases 

.jo the channel coding gains. Furthermore, the soft-decision channel codec metrics can be also invoked in 

151 estimating the instantaneous channel quality, irrespective of the type of channel impairments, 

is? A range of coded AQAM schemes were analysed by Matsuoka et al [6], Lau et al [14] and Gold- 

153 smith et al [10]. For data transmission systems, which do not necessarily require a low transmission 

154 delay, variable-throughput adaptive schemes can be devised, which operate efficiently in conjunction 
iss with powerful error correction codecs, such as long block length turbo codes. However, the acceptable 
is* turbo interleaving delay is rather low in the context of low-delay interactive speech. Video communica- 
157 tions systems typically require a higher bitrate than speech systems and hence they can afford a higher 
iss interleaving delay. 

is9 The above principles - which were typically investigated in the context of narrowband modems - were 

160 further advanced in conjunction with wideband modems, employing powerful block turbo coded wide- 

161 band Decision Feedback Equaliser (DFE) assisted AQAM transceivers [15]. A neural-network Radial 
ma Basis Function (RBF) DFE based AQAM modem design was proposed in [16], where the RBF DFE 

163 provided the channel quality estimates for the modem mode switching regime. This modem was capa- 

164 ble of removing the residual BER of conventional DFEs, when linearly non-separable received phasor 
iss constellations were encountered. 

166 The above burst-by-burst adaptive principles can also be extended to Adaptive Orthogonal Frequency 

»67 Division Multiplexing (AOFDM) schemes [17]. The associated AQAM principles were invoked in the 

•68 context of parallel AOFDM modems also by Czylwik et al [18], Fischer [19] and Chow et al [20]. 

169 Our main contribution is that upon invoking the technique advocated - irrespective of the channel con- 

t7o ditions experienced - the transceiver achieves always the best possible video quality by automatically 

6 
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m adjusting the achievable bitrate and the associated video quality in order to match the channel quality ex- 

in perienced. This is achieved on a near-instantaneous basis under given propagation conditions in order to 

.73 cater for the effects of path-loss, fast-fading, slow-fading, dispersion, co-channel interference, etc. Fur- 

i7i thermore, when the mobile is roaming in a hostile outdoor propagation environment, typically low-order, 

us low-rate modem modes are invoked, while in benign indoor environments predominantly the high-rate, 

t78 high source-signal representation quality modes are employed. 

.77 3.2 ACDMA Signalling Scenarios 

•78 ACDMA transmission parameter adaptation is an action of the transmitter in response to time- varying 

t79 channel conditions. It is only suitable for duplex communication between two stations, since the trans- 

i8o mission parameter adaptation relies on some form of channel estimation and signalling. In order to 

iai efficiently react to the changes in channel quality, the following steps have to be taken: 

tea • Channel quality estimation: In order to appropriately select the transmission parameters to be 

183 employed for the next transmission, a reliable prediction of the channel quality during the next 

184 active transmit timeslot is necessary. 

t8s • Choice of the appropriate parameters for the next transmission: Based on the prediction of the 

188 expected channel conditions during the next timeslot, the transmitter has to select the appropriate 

187 modulation schemes for the subcarriers. 

(as • Signalling or blind detection of the employed parameters: The receiver has to be informed, as 

•as to which set of demodulator parameters to employ for the received packet. This information can 

190 either be conveyed within the packet, at the cost of loss of useful data bandwidth, or the receiver 

191 can attempt to estimate the parameters employed at the transmitter by means of blind detection 
IK mechanisms. 

193 Depending on the channel characteristics, these operations can be performed at either of the duplex 

194 stations, as shown in Figures 1(a), 1(b) and 1(c). If the channel is reciprocal, then the channel quality 
i9s estimation for each link can be extracted from the reverse link, and we refer to this regime as open- 
198 loop adaptation. In this case, the transmitter needs to communicate the transmission parameter set to 

197 the receiver (Figure 1(a)), or the receiver can attempt blind detection of the transmission parameters 

198 employed (Figure 1(c)). 

199 If the channel is not reciprocal, then the channel quality estimation has to be performed at the receiver 

200 of the link. In this case, the channel quality measure or the set of requested transmission parameters is 
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201 communicated to the transmitter in the reverse link (Figure 1(b)). This mode is referred to as closed-loop 

202 adaptation. 

2M 33 Video Transceiver 

204 The schematic of the whole system is depicted in Figure 2. The multimedia source signal generated by 

205 the video encoder of Figure 2 is assembled into transmission packets constituting a CDMA transmission 

206 burst and the bits may be additionally mapped by the Mapper of Figure 2 to n number of different 

207 Forward Error Correction (FEC) protection classes. These bits are then convenveyed to the optional 
2oa Time Division Multiplex (TDMA)/ Time Division Duplex (TDD) scheme of Figure 2, before they are 

209 assigned to the AQAM/ACDMA modem seen in Figure 2. 

210 Again, the philosophy of the proposed burst-by-burst adaptive joint detection CDMA scheme is that the 
signal to interference plus noise ratio (SENR) at the output of the multi-user receiver is used in order to 

212 estimate the instantaneous channel quality. In one of its possible embodiments the receiver then decides 

213 on the transmitter's mode to be used during the next transmission burst on the basis of the received signal 
2t4 quality and the receiver's perception of the channel quality is signalled to the remote transmitter, in order 
2is to allow it to satisfy the receiver's integrity requirement. 

216 In this study we transmitted 176x144 pixel Quarter Common Intermediate Format (QCDF) and 128x96 

217 pixel Sub-QCIF (SQCIF) video sequences at 10 frames/s using a reconfigurable Time Division Multiple 

218 Access / Code Division Multiple Access (TDMA / CDMA) transceiver, which can be configured as a 1, 

219 2 or 4 bit/symbol scheme shown in Figure 2. The H.263 video codec exhibits an impressive compression 

220 ratio, although this is achieved at the cost of a high vulnerability to transmission errors, since a run-length 
22% coded stream is rendered undecodable by a single bit error. In order to mitigate this problem, when the 
-22 channel codec protecting the video stream is overwhelmed by the transmission errors, we refrain from 

223 decoding the corrupted video packet in order to prevent error propagation through the reconstructed video 

224 frame buffer [2]. We found that it was more beneficial in video quality terms, if these corrupted video 

225 packets were dropped and the reconstructed frame buffer was not updated, until the next video packet 

226 replenishing the specific video frame area was received. The associated video performance degradation 

227 was found perceptually unobjectionable for packet dropping- or transmission frame error rates (FER) 

228 below about 5%. These packet dropping events were signalled to the remote decoder by superimposing 

229 a strongly protected one-bit packet acknowledgement flag on the reverse -direction packet, as outlined 

230 in [2]. Bose-Chaudhuri-Hocquenghem (BCH) and turbo error correction codes were used and again, 

231 the CDMA transceiver was capable of transmitting I, 2 and 4 bits per symbol, where each symbol was 

232 spread using a low spreading factor (SF) of 16, as seen in Table 1. 
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1 ■ — 

j Parameter 




Multiple access 


TD MA/CDMA 


Channel type 


COST 207 Bad Urban 


Number of paths in channel 


7 


Normalised Doppler frequency 


3.7 x 1(T 5 


CDMA spreading factor 


16 


Spreading sequence 


Random 


Frame duration 


4.615 ms 


Burst duration 


577 , 


Joint detection CDMA receiver 


Whitening matched filter (WMF) or Minimum 
mean square error block decision feedback 
equalizer (MMSE-BDFE) 


No. of Slots/Frame 


8 


TDMA frame length 


4.615ms 


TDMA slot length 


577jis 


TDMA slots/Video packet 


3 


Chip Periods/TDMA slot 


1250 


Data Symbois/TDMA slot 


68 


User Data Symbol Rate (kBd) 


14.7 


System Data Symbol Rate (kBd) 


117.9 



Table 1: Generic system parameters using the Frames spread speech/data mode 2 proposal [1 1] 



-233 The associated parameters will be addressed in more depth during our further discourse. Employing 

234 a low spreading factor of 16 allowed us to improve the system's multi-user performance with the aid 

23s of joint-detection techniques [21]. We note furthermore that the implementation of the joint detection 

238 receivers is independent of the number of bits per symbol associated with the modulation mode used, 

237 since the receiver simply inverts the associated system matrix and invokes a decision concerning the 

238 received symbol, irrespective of how many bits per symbol were used. Therefore, joint detection 

239 receivers are amenable to amalgamation with the above 1, 2 and 4 bit/symbol modem, since they 
2*o do not have to be reconfigured each time the modulation mode is switched. 

2«i In this performance study we used the Pan-European FRAMES proposal [1 1] as the basis for our CDMA 

2*2 system. The associated transmission frame structure is shown in Figure 3, while a range of generic system 

9 
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Features 


BCH coding 


Turbo coding 


Modulation 


4QAM 


Transmission bitrate (kbit/s) 


29.5 


Video-rate (kbit/s) 


13.7 


1 1.1 


Video framerate (Hz) 


10 



Table 2: FEC-protected and unprotected BCH and Turbo coded bitrates for the 4QAM transceiver mode 

243 parameters are summarised in Table I. In our performance studies we used the COST207 seven-path bad 

244 urban (BU) channel model, whose impulse response is portrayed in Figure 4. 

245 Our initial experiments compared the performance of a whitening matched filter (WMF) for single user 
2«s detection and the Minimum mean square error block decision feedback equalizer (MMSE-BDFE) for 
:47 joint multi-user detection. These simulations were performed using 4-level Quadrature Amplitude Mod- 

248 ulation (4QAM), transmitting both binary BCH and turbo coded video packets. The associated bitrates 

249 are summarised in Table 2. 

2M The transmission bitrate of the 4QAM modem mode was 29.5Kbps, which was reduced due to the ap- 

251 proximately half-rate BCH or turbo coding, plus the associated video packet acknowledgement feedback 

252 flag error control and video packetisation overhead to produce effective video bitrates of 13.7Kbps and 

253 1 1.1Kbps, respectively. A more detailed discussion on the video packet acknowledgement feedback 

254 error control and video packetisation overhead will be provided in Section 3.4 with reference to the 

255 convolutionally coded multi-mode investigations. 

256 Figure 5 portrays the bit error ratio (BER) performance of the BCH coded video transceiver using both 

257 matched filtering and joint detection for 2-8 users. The bit error ratio is shown to increase, as the number 
-.ja of users increases, even upon employing the MMSE-BDFE multi-user detector (MUD). However, while 
259 the matched filtering receiver exhibits an unacceptably high BER for supporting perceptually unimpaired 
2«o video communications, the MUD exhibits a far superior BER performance. 

261 When the BCH codec was replaced by the turbo-codec, the bit error ratio performance of both matched 

262 filtering and the MUD receiver improved, as shown in Figure 6. However, as expected, matched filtering 

263 was still outperformed by the joint detection scheme for the same number of users. Furthermore, the 

264 matched filtering performance degraded rapidly for more than two users. 

265 Figure 7 shows the video packet loss ratio (PLR) for the turbo coded video stream using matched filtering 
26e and joint detection for 2-8 users. The figure clearly shows that the matched filter was only capable of 
26? meeting the target packet loss ratio of 5% for upto four users, when the channel SNR was in excess of 
268 1 1 dB. However, the joint detection algorithm guaranteed the required video packet loss ratio performance 

10 
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rr~ ■ 

(Features 


(I Multi-rate System 


Mode 


BPSK 


4QAM 


16QAM 


Bits/Symbol 


I 


2 


A 


FEC 


Convolutional 


Coding 


Transmitted bits/packet 


204 


| 408 


816 


Total bitrate (kbit/s) 


14.7 


29.5 


58.9 


FEC-coded bits/packet 


102 


204 


408 


Assigned to FEC-coding (kbit/s) 


7.4 


14.7 


29.5 


Error detection per packet 


16 bit CR 


C 


Feedback bits / packet 


9 


Video packet size 


77 


179 


383 


Packet header bits 


8 


9 


10 


Video bits/packet 


69 


170 


373 


Unprotected video-rate (kbit/s) 


5.0 


12.3 


26.9 


Video framerate (Hz) 


10 





Table 3: Operational-mode specific transceiver parameters for the proposed multi 



mode system 



- for 2-8 users in the entire range of channel SNRs shown. Furthermore, the 2-user matched- filtered PLR 
j'o performance was close to the 8-user MUD PLR. 

». 3.4 Multi-mode Video System Performance 

J Having shown that joint detection can substantially improve our system's performance, we investigated 

- the performance of a multi-mode convolution^ coded video system employing joint detection, while 
• supporting two users. The associated convolutional codec parameters are summarised in Table 3 

Be ' 0W WC n ° W d£tail video P**etisa,ion method employed. The reader is reminded that the number 

- of symbols per TDMA frame was 68 according to Table 1. In the 4QAM mode this would give 136 bits 

- per TDMA frame. However, if we transmitted one video packet per TDMA frame, then the packetisation 

- overhead would absorb a large percentage of the available bitrate. Hence we assembled larger video 
« packets, thereby reducing the packetisation overhead and arranged for transmitting the contents of a 
« video packet over three consecutive TDMA frames, as indicated in Table 1. Therefore each protected 
» video packet consists of 68 * 3 = 204 modulation symbols, yielding a transmission bitrate of between 

- 14.7 and 38.9 Kbps for BPSK and 16QAM, respectively. However, in order to protect the video data 
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we employed half-rate, constraint-length nine convolutional coding, using octal generator polynomials 

-84 of 561 and 753. The useful video bitrate was further reduced due to the 16-bit Cyclic Redundancy 

2B5 Checking (CRC) used for error detection and the nine-bit repetition-coded feedback error flag for the 

2M reverse link. This results in video packet sizes of 77, 179 and 383 bits for each of the three modulation 

2B7 modes. The useful video capacity was finally further reduced by the video packet header of between 8 

288 and 10 bits, resulting in useful or effective video bicrates ranging from 5 to 26.9 Kbps in the BPS K and 

289 16QAM modes, respectively. 

290 The proposed multi-mode system can switch amongst the 1. 2 and 4 bit/symbol modulation schemes 

291 under network control, based upon the prevailing channel conditions. As seen in Table 3, when the 

292 channel is benign, the unprotected video bitrate will be approximately 26.9Kbps the 16QAM mode. 

293 However, as the channel quality degrades, the modem will switch to the BPSK mode of operation, where 
j* the video bitrate drops to 5Kbps, and for maintaining a reasonable video quality, the video resolution has 

295 to be reduced to SQCIF (128x96 pels). 

296 Figure 8 portrays the packet loss ratio for the multi-mode system, in each of its modulation modes for a 

297 range of channel SNRs. It can be seen in the figure that above a channel SNR of l4dB the 16QAM mode 

298 offers an acceptable packet loss ratio of less than 5%. while providing an unprotected video rate of about 

299 26.9Kbps. If the channel SNR drops below l4dB, the multi-mode system is switched to 4QAM and 

300 eventually to BPSK, when the channel SNR is below 9dB, in order to maintain the required quality of 

301 service, which is dictated by the packet loss ratio. The figure also shows the acknowledgement feedback 

302 error ratio (FBER) for a range of channel SNRs, which has to be substantially lower, than the video 

303 PLR itself. This requirement is satisfied in the figure, since the feedback errors only occur at extremely 
3w low channel SNRs, where the packet loss ratio is approximately 50%, and it is therefore assumed that 

is the multi-mode system would have switched to a more robust modulation mode, before the feedback 

308 acknowledgement flag can become corrupted. 

30? The video quality is commonly measured in terms of the peak-signal-to-noise-ratio (PSNR). Figure 9 

308 shows the video quality in terms of the PSNR versus the channel SNRs for each of the modulation 

309 modes. As expected, the higher throughput bitrate of the 16QAM mode provides a better video quality. 

310 However, as the channel quality degrades, the video quality of the 16QAM mode is reduced and hence 
sit it becomes beneficial to switch from the 16QAM mode to 4QAM at an SNR of about 14dB, as it was 

312 suggested by the packet loss ratio performance of Figure 8. Although the video quality expressed in 

313 terms of PSNR is superior for the 16QAM mode in comparison to the 4QAM mode at channel SNRs 
3m in excess of 12dB, however, due to the excessive PLR the perceived video quality appears inferior in 
3is comparison to that of the 4QAM mode, even though the 16QAM PSNR is higher for channel SNRs 
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ate in the range of !2-14dB. More specifically, we found that it was beneficial to switch to a more robust 

317 modulation scheme, when the PSNR was reduced by about IdB with respect to its unimpaired PSNR 

3ie value. This ensured that the packet losses did not become subjectively apparent, resulting in a higher 

319 perceived video quality and smoother degradation, as the channel quality deteriorated. 

320 The effect of packet losses on the video quality quantified in terms of PSNR is portrayed in Figure 10. 

321 The figure shows, how the video quality degrades, as the PLR increases. It has been found that in order 

322 to ensure a seamless degradation of video quality as the channel SNR reduced, it was the best policy 

323 to switch to a more robust modulation scheme, when the PLR exceeded 5%. The figure clearly shows 
»4 that a 5% packet loss ratio results in a loss of PSNR, when switching to a more robust modulation 

325 scheme. However, if the system did not switch until the PSNR of the more robust modulation mode 

326 was similar, the perceived video quality associated with the originally higher rate, but channel-impaired 
ur stream became inferior. 



326 3.5 Burst-by-Burst adaptive videophone system 

329 A burst-by-burst adaptive modem, maximizes the system's throughtput by using the most appropriate 

330 modulation mode for the current instantaneous channel conditions. Figure 1 1 exemplifies, how a burst- 

331 by-burst adaptive modem changes its modulation modes based on the fluctuating channel conditions. The 

332 adaptive modem uses the SINR estimate at the output of the joint-detector to estimate the instantaneous 

333 channel quality, and hence to set the modulation mode. 

334 The probability of the adaptive modem using each modulation mode for a particular channel SNRs is 

335 portrayed in Figure 12. It can be seen at high channel SNRs that the modem mainly uses the 16QAM 

336 modulation mode, while at low channel SNRs the BPSK mode is most prevalent. 

The advantage of dynamically reconfigured burst-by -adaptive modem over the statically switched multi- 

33a mode system previously described, is that the video quality is smoothly degraded as the channel condi- 

339 tions deteriorate. The switched multi-mode system results in more sudden reductions in video quality. 

340 when the modem switches to a more robust modulation mode. Figure 13 shows the throughput bitrate 

341 of the dynamically reconfigured burst-by- burst adaptive modem, compared to the three modes of the 

342 statically switched multi-mode system. The reduction of the fixed modem modes' effective throughput 

343 at low SNRs is due to the fact that under such channel conditions an increased fraction of the transmitted 

344 packets have to be dropped, reducing the effective throughtput. The figure shows the smooth reduction of 
34s the throughput bitrate, as the channel quality deteriorates. The burst-by -burst modem matches the BPSK 

346 mode's bitrate at low channel SNRs, and the 16QAM mode's bitrate at high SNRs. The dynamically 

347 reconfigured burst-by-burst adaptive modem characterised in the figure perfectly estimates the prevalent 
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34< channel conditions although in practice the estimate of channel quality is not perfect and it is inherently 

3« delayed. However, we have found that non-perfect channel estimates result in only slightly reduced 

350 performance, when compared to perfect channel estimation. 

33» The smoothly varying throughput bitrate of the burst-by- burst adaptive modem translates into a smoothly 

is? varying video quality as the channel conditions change. The video quality measured in terms of the 

353 average peak signal io noise ruiio (PSNR) is shown versus the channel SNR in Figure 14 in contrast to 

334 that of the. individual modem modes. The figure demonstrates that the burst-by-burst adaptive modem 

355 provides equal or better video quality over a large proportion of the SNR range shown than the individual 

356 modes. However, even at channel SNRs, where the adaptive modem has a slightly reduced PSNR, the 

357 perceived video quality of the adaptive modem is better since the video packet loss rate is far lower, than 

358 that of the fixed modem modes. 

.9 Figure 15 shows the video packet loss ratio versus channel SNR for the three fixed modulation modes 

360 and the burst-by-burst adaptive modem with perfect channel estimation. Again the figure demonstrates 

36> that the video packet loss ratio of the adaptive modem is similar to that of the fixed BPSK modem mode. 

M2 however the adaptive modem has a far higher bitrate throughput, as the channel SNR increases. The 

363 burst-by-burst adaptive modem gives an error performance similar to that of the BPSK mode, but with 

364 the flexibity to increase the bitrate throughput of the modem, when the channel conditions improve. If 

365 imperfect channel estimation is used, the throughput bitrate of the adaptive modem is reduced slightly. 

366 Furthermore, the video packet loss ratio seen in Figure 15 is slightly higher for the AQAM scheme due 

367 to invoking higher-order modem modes, as the channel quality increases. However we have found that 
366 is possible to maintain the video packet loss ratio within tolerable limits for the range of channel SNRs 
369 considered. 

o The interaction between the video quality measured in terms of PSNR and the video packet loss ratio 

371 can be more clearly seen in Figure 16. The figure shows that the adaptive modem slowly degrades 

372 the decoded video quality from that of the error free 16QAM fixed modulation mode, as the channel 

373 conditions deteriorate. The video quality degrades from the error-free 41dB PSNR, while maintaining a 

374 near-zero video packet loss ratio, until the PSNR drops below about 36dB PSNR. At this point the further 

375 reduced channel quality inflicts an increased video packet loss rate and the video quality degrades more 

376 slowly. The PSNR versus packet loss ratio performance then tends toward that achieved by the fixed 

377 BPSK modulation mode. However the adaptive modem achieved better video quality than the fixed 
37a BPSK modem even at high packet loss rates. 
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3.6 Summary 

3M A joint-detection assisted multimode CDMA-based video transceiver was proposed, which substantially 

381 outperformed the conventional matched-filtering based transceiver, which was characterised by adap- 

382 cively reconfiguring the transceiver's mode of operation based on the instantaneous channel quality. In 
333 our transceiver a higher number of bits per modulation symbol was invoked by the transmitter, when 
384 the channel quality was sufficiently high for supporting this more bitrate efficient, but less error resilient 
aas transmission mode. By contrast, a more error resilient but less bitrate efficient mode was invoked for 
see supporting error-free CDMA transmission over wireless multi-user channels. 

387 In this embodiment the above property was exploited in a practical adaptive video transceiver, which 

388 instructed the video codec to generate the required number of bits that the CDMA transceiver was capable 
3M of delivering in its current channel-condition dependent configuration mode. 

390 In other embodiments the proposed burst-by-burst adaptive transceiver can be invoked in the context 

39» of arbitrary multimedia signals, irrespective of their resolution or source representation quality. Spe- 

392 cific further embodiments of such codecs are constituted by programmable-rate speech, audio, video, 

393 handwriting codecs, which can be configured by the transceiver to generate a channel-quality dependent 
39* number of source-coded bits. 

39s The proposed burst-by- burst adaptive video transceiver guaranteed a near-unimpaired video quality for 

39« channel SNRs in excess of about 5 dB over the COST207 dispersive Ray Ieigh- faded channel. The ben- 

397 efits of the multimode video transceiver clearly manifest themselves in terms of supporting un-impaired 

398 video quality under time- variant channel conditions, where a single-mode transceiver's quality would 

399 become severely degraded by channel effects. The dynamically reconfigured burst-by -burst adaptive 

400 modem gave better perceived video quality due to its more graceful reduction in video quality, as the 
..-ot channel conditions degraded, than a statically switched multi-mode system. 
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CLAIMS 

I. A method for CDMA transmission of a multimedia signal over a transmission 

medium, the method comprising: 

providing a transmitter operabie to transmit in a plurality of modulation modes 
5 varying in bit rate and error resilience between a highest bit rate, lowest error 

resilience mode and a lowest bit rate, highest error resilience mode; 

obtaining a channel quality measure for current transmission; and 

switching to a more or less error resilient modulation mode each time the 

channel quality measure respectively degrades or improves by a defined amount, 
10 whereby multimedia signal quality varies smoothly with varying channel quality of the 

transmission medium. 



2. A method according to claim 1, wherein the channel quality measure is a 
multimedia signal quality dependent signal-to-noise value. 

15 

3. A method according to claim 2, wherein the defined amount is set with 
reference to an unimpaired signal-to-noise value. 

4. A method according to claim 2 or 3, wherein the signal-to-noise value is a peak 
20 signal-to-noise ratio for a multimedia video signal. 

5. A method according to claim 2 or 3, wherein the signal-to-noise value is a 
segmental signal-to-noise ratio for a multimedia speech signal. 

25 6. A method according to claim 1, wherein the channel quality measure is a 
packet loss value. 

7. A method according to claim 1, wherein the packet loss value is varied 
dependent upon desired multimedia signal quality. 

30 
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8. A method according to claim 1, wherein the channel quality measure is a bit 
error rate. 

9. A method according to any one of claims 1 to 8, wherein the channel quality 
5 measure is based on monitoring signal integrity at a remote receiver. 

10. A method according to any one of claims 1 to 8, wherein the channel quality 
measure is based on monitoring signal integrity at a receiver local to the transmitter. 

10 11. A transmitter for transmission of a multimedia source signal over a 
transmission medium to a remote receiver, the transmitter comprising a CDMA 
modem having an output for transmitting a multimedia source signal and an input for 
receiving a channel quality measure for current transmission, wherein the CDMA 
modem is switchable between a plurality of modulation modes varying in bit rate and 

1 5 error resilience between a highest bit rate, lowest error resilience mode and a lowest bit 
rate, highest error resilience mode, such that the CDMA modem is switched to a more 
or less error resilient modulation mode each time the channel quality measure 
respectively degrades or improves by a defined amount, whereby multimedia signal 
quality is smoothly variable with varying channel quality of the transmission medium. 

20 

12. A transmitter according to claim 11, wherein the channel quality measure is a 
multimedia signal quality dependent signal-to-noise value. 

13. A transmitter according to claim 12, wherein the defined amount is set with 
25 reference to an unimpaired signal-to-noise value. 

14. A transmitter according to claim 12 or 13, wherein the signal-to-noise value is 
a peak signal-to-noise ratio for a multimedia video signal. 

30 15. A transmitter according to claim 12 or 13, wherein the signal-to-noise value is 
a segmental signal-to-noise ratio for a multimedia speech signal. 
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16. A transmitter according to claim 11, wherein the channel quality measure is a 
packet loss value. 

17. A transmitter according to claim 11, wherein the packet loss value is variable 
5 dependent upon desired multimedia signal quality. 

18. A transmitter according to claim 1 1, wherein the channel quality measure is a 
bit error rate. 

10 19. A transmitter according to any one of claims 11 to 18, wherein the channel 
quality measure is based on monitoring signal integrity at a remote receiver. 

20. A transmitter according to any one of claims 11 to 18, wherein the channel 
quality measure is based on monitoring signal integrity at a receiver local to the 

1 5 transmitter. 

21. A transmission system for transmission of multimedia source signals over a 
transmission medium, the system comprising: 

a first transceiver including a local receiver and a local transmitter according to 
20 any one of claims 1 1 to 20; and 

a second transceiver including a remote receiver and a remote transmitter 
according to any one of claims 1 1 to 20. 
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